People Watching: Human Actions as a Cue for Single View Geometry

Human Actions as a Cue for Single View Geometry

We present an approach which exploits the coupling between human actions and scene geometry to use human pose as a cue for single-view 3D scene understanding. Our method builds upon recent advances in still-image pose estimation to extract functional and geometric constraints on the scene. These constraints are then used to improve single-view 3D scene understanding approaches. The proposed met...

People as Sensors: Imputing Maps from Human Actions

Despite growing attention in autonomy, there are still many open problems, including how autonomous vehicles will interact and communicate with other agents, such as human drivers and pedestrians. Unlike most approaches that focus on pedestrian detection and planning for collision avoidance, this paper considers modeling the interaction between human drivers and pedestrians and how it might inf...

Acquiring a nano-view of single molecules in actions

I n 1959, Nobel laureate Richard Feynman suggested that 'there is plenty of room at the bottom,' predicting the possibility of single-molecule detection and studies. Over the last 20 years, we have witnessed a rapid development in single-molecule spectroscopy. Single-molecule spectroscopy and imaging have been demonstrated to be a powerful molecular analytical approach to studying the complex a...

A Bayesian view on multimodal cue integration

Different brain correlates for watching real and virtual hand actions.

We investigated whether observation of actions reproduced in three-dimensional virtual reality would engage perceptual and visuomotor brain processes different from those induced by the observation of real hand actions. Participants were asked to passively observe grasping actions of geometrical objects made by a real hand or by hand reconstructions of different quality in 3D virtual reality as...